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PRINCIPAL  INVESTIGATOR:  Dr.  Stephanie  Doane  (e-mail:  sdoane@ra.psychoiogy.msstate.edu) 
INSTITUTION:  Mississippi  State  University 

GRANT  TITLE:  Integrating  Digital  Eye  Tracking  With  Personnel  Optimization  Research 

AWARD  PERIOD:  1  April  2002  -  3 1  March  2003 

OBJECTIVE: 

Eye  movements  made  during  problem-solving,  spatial  thinking,  and  decision-making  provide  useful 
information  about  the  processes  by  which  people  understand  visual  input  and  integrate  it  with  their  prior 
knowledge  and  memory  during  task  performance  (e.g.,  Just  &  Carpenter,  1993).  Eye  fixation  studies 
provide  a  detailed  account  of  the  time  course  of  processing,  indicating  the  sequence  of  pupil  fixations  and 
the  time  the  pupil  dwells  on  each  item  fixated.  Pupil  size  is  also  measured  and  used  as  an  indication  of 
cognitive  workload  (Just  &  Carpenter,  1993;  Marshall  et  al.,  1997). 

Traditionally,  cognitive  science  researchers  have  focused  on  two  performance  measures:  reaction  time  and 
response  accuracy.  While  such  measures  provide  important  information,  their  interpretation  requires  indirect 
inferences  about  subject  focus  of  attention  during  task  performance.  In  contrast,  eye  movement  data 
provides  real-time  information  about  subject  focus  of  attention  during  task  performance.  Recent  cognitive 
science  research  integrates  eye  movements  with  traditional  performance  measures  to  study  what  humans 
attend  to  when  they  read  text,  comprehend  diagrams,  interact  with  computers,  pilot  aircraft,  and  perform 
other  complex  tasks  (e.g.,  Doane  &  Sohn,  2000;  Just  &  Carpenter,  1993;  Lee  &  Anderson,  2001;  Marshall 
et  al.,  1997).  The  addition  of  eye  movement  data  eliminates  any  number  of  indirect  inferences  researchers 
must  make  when  analyzing  and  interpreting  human  performance  data.  For  example,  a  researcher  observing 
reading  skill  who  is  limited  to  reading  speed  and  comprehension  measures  may  be  unable  to  identify  the 
locus  of  individual  differences  in  performance.  Integrating  eye  movements  with  the  other  performance 
measures  allows  the  researcher  to  determine  the  reader's  real-time  visual  focus  and  this  information 
disambiguates  the  underlying  causes  of  performance  differences.  Eye  tracking  is  foe  technique  researchers 
used  to  determine  where  their  subjects  were  looking  and  pupil  status  (e.g.,  dilation)  during  task 
performance  (e.g.,  reading  a  diagram,  viewing  a  radar  screen).  While  foe  technique  appears  straightforward, 
these  measures  are  difficult  to  achieve  and  require  high  precision  instruments  as  well  as  sophisticated  data 
analysis  and  interpretation  tools  (e.g.,  Marshall,  1997;  Salvucci  &  Anderson,  2001). 

The  objective  of  this  award  was  to  fund  the  purchase  of  a  Digital  Eye  Tracking  Research  System  (DETRS). 
DETRS  is  a  state-of-the-art  system  that  gives  cognitive  science  researchers  at  Mississippi  State  University 
the  capability  to  integrate  eye  movements  into  their  personnel  optimization  research.  The  DETRS  enables 
foe  seamless  integration  of  eye  tracking  technology  with  Digital  Video  (DV)  camcorders  and  Cassette 
Recorders  (DVCR)  by  capturing  video  data  in  a  digital  format.  It  enables  simultaneous  access  to  several 
aspects  of  foe  same  performance,  such  as  pupil  measures  and  point  of  gaze,  and  the  ability  to  cross 
reference  data  from  multiple  subjects.  The  non-linear  digital  data  allows  the  selection  of  particular  frames  or 
crucial  moments  and  this  enables  focused  analysis  and  display  of  foe  data  of  interest.  The  DETRS  includes 
high-precision  eye  tracking  instruments  and  components  that  enable  the  analysis  and  interpretation  of  foe 
massive  data  sets.  The  DETRS  is  configured  to  maintain  portability  for  field  experiments  and  still  provide 
the  data  storage  and  processing  capacity  necessary  for  archiving,  editing,  and  analyzing  data. 

The  DETRS  provides  the  opportunity  for  faculty  and  students  to  gain  experience  in  eye  tracking  research, 
where  they  learn  how  to  1)  design  and  execute  eyetracker  experiments,  2)  integrate  digital  video  and  eye 
movement  data,  3)  perform  statistical  analyses  of  eyetracker  data,  4)  integrate  eyetracker  data  with  other 
performance  measures,  5)  computationally  model  human  eye  movements  and  compare  them  to  actual  eye 
movements,  and  6)  write  publications  that  make  significant  contributions  to  personnel  optimization 
research. 


APPROACH:  The  DETRS  is  used  by  both  faculty  and  students  in  a  shared  facility  housed  in  the 
Department  of  Psychology.  The  DETRS  includes  individual  workstations  housed  in  investigator  labs,  as 
well  as  servers  located  in  a  shared  facility.  In  some  cases,  the  DETRS  workstations  have  replaced  aging 
systems  in  the  individual  laboratories  and,  in  so  doing,  provide  the  computational  power  necessary  to 
perform  state-of-the-art  eye  tracking  research.  The  2  eyetrackers  are  housed  in  the  shared  facility  unless 
checked  out  for  field  research. 

ACCOMPLISHMENTS:  All  of  the  DETRS  equipment  has  arrived  and  is  in  use.  A  list  of  the  purchased 
equipment  is  indicated  in  Table  1.  Mississippi  State  University  provided  funds  for  laboratory  remodeling 
necessary  to  house  the  DETRS.  The  remodeling  was  completed  in  July  2002.  The  remodeled  rooms  house 
the  servers,  oculometers,  and  workstations  required  to  integrate  eye-tracking  technology  into  personnel 
optimization  research.  In  addition,  we  have  completed  instructional  documentation  that  facilitates  the  use 
of  the  DETRS  equipment  by  faculty  and  students  unfamiliar  with  eye  tracking  research. 

CONCLUSIONS:  The  equipment  purchased  is  enhancing  or  has  enhanced  the  research  and  research-related 
education  of  seven  personnel  optimization  research  projects  funded  by  the  Office  of  Naval  Research 
(N00014-02-1-0152,  NOO0I4-02-1-O898,  N00014-00- 1-0560,  N00014-03-1-0088,  N00014-02-1-01 14, 
N00014-01-1-0093,  N00014-01-1-0091)  and  a  National  Science  Foundation  grant  (DUE  0089420)  and 
supervised  by  investigators  affiliated  with  the  Applied  Cognitive  Science  program  at  Mississippi  State 
University. 

SIGNIFICANCE:  The  DETRS  provides  the  opportunity  for  faculty  and  students  to  gain  experience  in  eye 
tracking  research,  where  they  will  learn  how  to  1)  design  and  execute  eyetracker  experiments,  2)  integrate 
digital  video  and  eye  movement  data,  3)  perform  statistical  analyses  of  eyetracker  data,  4)  integrate 
eyetracker  data  with  other  performance  measures,  5)  computationally  model  human  eye  movements  and 
compare  them  to  actual  eye  movements,  and  4)  write  publications  that  make  significant  contributions  to 
personnel  optimization  research. 

PATENT  INFORMATION:  No  patents  reported. 

AWARD  INFORMATION:  Doane  promoted  to  Professor,  Department  of  Psychology,  Mississippi  State 
University. 
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Table  1.  All  equipment  and  software  has  been  purchased  and  is  in  use.  Following  is  a  list  of  all 
equipment  purchased  by  this  grant  and  the  purpose  for  each  item: 


Quantity  :  Data  Integration  Component 


1  Office  X 


Office  for  Dell  Laptop/Deskt 


2  Macromedia  eLearning  Studio  Full 
Version 


1  [Microsoft  Visio  Pro  2002 


Photoshop  7  Upgrade 


Portfolio  6.0 


Stufflt  Deluxe  6.5 


Apple  Remote  Desktop 


Franz  lisp 


Plextor  Plex  Writer 


G4 


Apple  Studio  17"  Flat 


G4  Workstation 


I  Apple  Studio  17"  Flat 


[Apple  Protection  Plan  for  Power  Mac 


G4  Media  Center 


le  22”  Cinema  Display 


lApple  Protection  Plan  for  Power  Mac 


[Apple  Pro  Speakers 


8150DN 


J512  K  memory 


Canon  GL-2 


Sony  19"  Monitors 


Dell  Dimension  2200  (No  Monitor) 


Purpose 


■Data  processing  andnublication  of  research 


Data  processing  and  publication  of  research 


Writing  programs  to  create  computer  tests  and  spatial 
cognition  tests 


J Building  flowcharts  and  other  visual  aids  to  map  software 
development  paths  and  cognitive  models 


Drawing  and  adapting  figures  for  experiments  and 
publication. 


J  Organize  images  on  hard  drives  by  displaying  thumbnails 
in  the  Finder  _ 


File  compression  program  for  extracting  files  fro  Internet 
archives 


[Provide  remote  administration  to  Macs  within  the  lab 


Programming  in  LISP  for  working  with  cognitive 
modeling  architectures,  ACT-R,  and  Construction- 
Integration  to  create  cognitive  models 


Bum  CD  backups  of  lab  information  and  storage  of  data 


J  Prepare  and  program  experiments,  prepare  stimulus 
materials,  and  analvze  results 


[Monitor  for  use  with  computers  in  research  and  publication 


J  Integrate,  analyze,  and  archive  digital  eye  movement  and 
video  data 


Monitors  for  use  with  computers  in  research  and 
[publication 


IWarranties 


Process  video  records  of  experiments,  promotional  video 
.  footage,  and  high-oualitv  images  for  various  proiects. 


IPartof  media  center 


Warranties 


[Part  of  media  center 


[Provide  hard 


defer  Macs 


Data  collection  in  eye  tracking  and  creating  stimulus 
Imateiials 


Use  with  G4s  above 


lUsed  for  research-related  education 


5 

Workstation  Desk 

2 

Tables  Lab 

3 

Chairs 

Workstations  for  computers  and  oculometers 


Workstations  for  computers  and  other  equipment 


Quantity 

Eye  Tracking  Component 

: ,  Purpose  ^  -i 

3 

Dell  Precision  340 

Run  software  that  controls  the  ASL  eye  trackers  and  serve 
as  exDeriment  stations  for  the  eve  trackers. 

2 

Dell  Latitude  Laptop 

Run  software  that  controls  the  ASL  eye  trackers  and  serve 
as  experiment  stations  for  the  eye  trackers.  Provide 
workstation  mobility  for  field  exDeriments 

3 

ASL  Model  501 

Record  subject  eve  movements  during  task  performance. 

3 

Eyehead  Package 

Record  subject  eve  movements  during  task  Derformance. 

2 

Upgrade  60Hz  Camera 

Lin  grade  cameras  on  eve  trackers 

2 

Digital  Video  Camcorder 

Record  real-time  scenarios  and  audio  communications 
during  task  Derformance. 

2 

Hard  drives  for  Dells 

Renlaced  dysfunctional  drives  on  2  comouters 

1 

Jeppesen  JT201008  Instrument 

Provide  realistic  interface  to  flight  simulation  software 

1 

PFC  Cirrus  Yoke 

Provide  realistic  interface  to  flight  simulation  software 

1 

PFC  Cirrus  Rudders 

Provide  realistic  interface  to  flight  simulation  software 

£  Quantity 

Data  Analysis  and  Computational 
: '.Modeling  Component?-  A 

J*'  '  -Purpose  \  ■■ 

2 

Sun  V880  (4  processor) 

Process  data  collected  from  pilots  in  simulated  flight  in 
real  time  -  Drocess  oculometer  data 

4 

Color  Graphics  Card 

Video  add-on  to  connect  monitors  to  V880s 

2 

Sun  Blade  100 

Perform  statistical  evaluation  of  research  data  and 
comnutational  modeling 

2 

Keyboard  Kit 

Part  of  nurchased  Suns 

4 

Sim  monitors  21" 

Part  of  nurchased  Suns 

2 

APC  Smart  UPS  2200 

BackuD  uower  surmlv  for  servers 

1 

Netgear  5pt  10/100  Switch 

Ethernet  switch 

1 

Autoloader  &  Host  Adapter 

Automatically  changes  tapes  during  backup.  Adapter  allows 
V880  to  communicate  with  autoloader 

Quantify  : : 

%  ’  ri  Peripherals  for  equipment  L % 

:  rt’rnnse% 

3 

Sony  LCM-PCA  Carrying  Case 

Protects  handicam  units  from  physical  shock  damage  and 
keens  them  clean  and  drv 

1 

Y  cable 

Allows  connection  of  flight  yoke  and  foot  pedals  to  same 
computer  port 

4 

APC  Surge  Station 

Protect  Dell  computers  against  electrical  surge 

4 

Kablit  Security  Package 

Secure  and  protect  new  computers  against  theft 

2 

Snap-It  Security  Locks 

Secure  and  protect  new  computers  against  theft 

5 


